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Abstract 

In chemical analysis made by laboratories one has the problem of 
determining the concentration of a chemical element in a sample. In 
order to tackle this problem the guide EURACHEM/CITAC recom- 
mends the application of the linear calibration model, so implicitly 
assume that there is no measurement error in the independent vari- 
able X. In this work, it is proposed a new calibration model assuming 
that the independent variable is controlled. This assumption is appro- 
priate in chemical analysis where the process tempting to attain the 
fixed known value X generates an error and the resulting value is x, 
which is not an observable. However, observations on its surrogate X 
are available. A simulation study is carried out in order to verify some 
properties of the estimators derived for the new model and it is also 
considered the usual calibration model to compare it with the new ap- 
proach. Three applications are considered to verify the performance 
of the new approach. 

Keywords: linear calibration model, controlled variable, measurement 
error model, uncertainty, chemical analysis. 



1 



1 Introduction 



The usual calibration model pQ is commonly used to estimate the concen- 
tration X of a chemical species in a test sample. It typically assumes that 
the independent variable is fixed and it is not subject to error. However, in 
applications in analytical chemistry this variable is subject to error which 
arises from the preparation process of a standard solution. In many studies, 
such as [2], [3] and [I], it is attempted to consider the uncertainties due to 
the preparation process of the standard solutions by application of the error 
propagation law to the standard error of the estimator of X . 

We have that the concentration of the standard solution is pre-fixed by 
the chemical analyst and a process is carried out attempting to attain it, this 
process generates errors. Hence, in this case it arises the so called controlled 
variable [5], where the controlled variable X is defined by the pre-fixed con- 
centration value of the standard solution which is expressed by the equation 
X = x + 5, where x is the unobserved variable and 5 is the measurement 
error variable. 

In [6] it was proposed the so called homoscedastic controlled calibration 
model. This model is formulated in the framework of the usual calibration 
model assuming that the independent variable is a controlled variable and 
the associated measurement errors have equal variances. 

In [7] and j8], some methods to compute the uncertainties in certain val- 
ues obtained through measurements are studied. In [8], the uncertainties of 
standard solutions are computed and it is observed that these uncertainties 
depend on the concentration values, so we can observe that the usual calibra- 
tion model and the homoscedastic controlled calibration model seem not to 
be the more suitable ones. This problem motivates us to study a calibration 
model that considers the errors variability of the preparation of standard 
solutions. In this work we propose a calibration model that incorporates the 
errors variability arisen from the preparation process of the standard solu- 
tion and we call it as the heteroscedastic controlled calibration model. This 
work is a continuation to our previous paper [6] in which it was undertaken 
the study of the so-called homoscedastic controlled calibration model which 
assumed equal variance errors. 

The paper is organized as follows. In Section [2J we formulate the het- 
eroscedastic controlled calibration model. In Section [31 a simulation study 
to test the new approach is presented. In Section HI three applications are 
considered which show that the proposed model seems to be more adequate. 
Section [5] presents our concluding remarks. Finally, we present in Appendix 
IA1 the usual calibration model, and in Appendix [3] some tables showing the 
results of the simulation study. 
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2 The proposed model 



Among the relevant problems in chemical analysis is the one related to the 
estimation of the concentration Xq of a chemical compound in a given sample. 
In order to tackle this problem it is used a statistical calibration model, which 
is defined by a two-step process. This problem has been considered in [9] and 

The first stage of the calibration model is given by data points (X, Y) 
which is determined in an experiment where the independent variable X is 
the one that the experimenter selects. For instance, the concentrations of the 
standard solutions that a chemist prepares are independent variables since 
any concentration may be chosen. The dependent variable Y is a measurable 
property of the independent variable. For example, the dependent variable 
may be the amount of intensity supplied by the plasma spectrometry method, 
since the intensity depends on the concentration. 

In the second stage of the calibration model it is prepared a suitable 
sample related to the unknown concentration X in order to obtain the mea- 
surements Y . 

We have that the standard concentration X is fixed by the analyst and 
the process of preparation attempting to get it produces an error S, and the 
unobserved quantity attained is x. Considering the usual calibration model 
defined by the equations IA.1I and IA.2I in the Appendix |A] and the equation 
X = x + 6, we define the heteroscedastic controlled calibration model as 

Yi = a + f3x i + e i) i = 1,2 ■■■,n, (2.1) 
X t = Xi + 5i, z = l,2---,n, (2.2) 

Y 0i = a + f3X Q + e u i = n + 1, n + 2, • • • , n + k. (2.3) 

It is considered the usual calibration model assumptions (see Appendix A) 
in addition to the following conditions 

• Si, 82, ■ ■ ■ , S n are independent and normally distributed with mean 0. 

• the variances erf , (i = 1, ■ • • , n) are supposed to be known. 

• Si, i — 1, ■ ■ ■ , n and e^, i — 1, • • • , n + k are independent. 

Observe that in the model described above we only consider the case when 
the variances erf., % = l,---,n are known. It is a generalization of the 
homoscedastic controlled calibration model discussed in [B], when it is con- 
sidered erf. = erf for all % and the known erf case. This new model is also a 
generalization of the usual calibration model in which one takes Si = 0, i = 
l,---,n. 

For the heteroscedastic controlled calibration model the logarithm of the 
likelihood function is given by 

1 71 k 
l{ a, p, X ,a 2 e ) cx -- l°9{li) ~ ^og(a 2 e ) 
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where 7^ = of + /? 2 cx 2 ., i = 1, • • • , n. Solving dl/da = and dl/dX = one 
can get the maximum likelihood estimator of a and Xo given, respectively, 
by 

a = Y - (3X and X = (2.5) 



From ( 12. 4ft and ( 12. 5ft . it follows that the logarithm of the likelihood function 

for (a, (3, X , of) can be writen as 
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Making dl/dfl = 0, dl/da 2 = in the logarithm of the likelihood function 
2.6j) . we have the following equations 
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The estimates of /5 and a 2 can be obtained through some iterative method 
that solves the equations (12.71) and (12. 8p . 

The Fisher expected information 1(9) = I (a, fl,X ,a 2 ) is given by 
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When k = qn, q G Q + and n — > 00, the estimator is approximately 
normally distributed with mean 9 and variance I(9)~ l , thus the approximate 
variance to order n~ l for Xo is given by 
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Note that when erf. = 0, i = 1, • • • , n, the expression (12.91) is reduced to 
the variance of the usual model given in (1A.5I) and when erf. = erf (for all 
i) the expression (12. 9p is also reduced to the variance of the homoscedastic 
model when erf is known (see eq. (2.12) of ref. [5]). 

In order to construct a confidence interval for X we consider the interval 
( 1A.7j) . where V(X c) is the estimated variance that follows from (12.91) . 



3 Simulation study 

We present a simulation study to compare the performance of the estimators 
obtained from the heteroscedastic controlled calibration model (Proposed-M) 
with the results obtained by considering the usual model (Usual-M). 

It was considered 3000 samples generated from the Proposed-M. In all the 
samples, the parameters a and (3 take the values 0.1 and 2, respectively. The 
range of values for the controlled variable was [0,2]. The fixed values for the 
controlled variable were x\ = 0, X{ = Xj_i + 2/{n — 1), % = 2, ■ ■ ■ , n, and the 
parameter values X were 0.01 (extreme inferior value), 0.8 (near to the cen- 
tral value) and 1.9 (extreme superior value). For the first and second stages 
we consider the sample of sizes n = 5, 20, 100, 5000 and k = 2, 20, 100, 500, 
respectively. We consider erf = 0.04 and the maximum parameter values of 
erf as max{crf.}™ =1 = 0.1. We consider crf^ = i x Q.l/n for i — 1, • • • , n. 

The empirical mean bias is given by X^=°i (Xo — X )/3000 and the em- 
pirical mean squared error (MSE) is given by E?=i°(Xo - X ) 2 /3000. The 
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mean estimated variance of X is given by J2f=i V{X )/3000. The theoreti- 
cal variances of X is referred to the expressions (1A.5I) and (12. 9p evaluated on 
the relevant parameter values. In Appendix B it is presented the simulation 
results. 

In Table [TJ we observe that, in general, the bias of Xq from the usual 
model is smaller than the value supplied by the proposed model, but related 
to the MSE we have that the outcome from usual model is greater compared 
with MSE of the proposed model. Also, we observe that the mean estimated 
variance from the proposed model is closer to the theoretical variance as 
compared to the outcome from the usual model. 

Analyzing Table El we observe that the amplitude of the proposed model, 
in most cases, is smaller when compared with the estimate of the usual 
model. For all n and X the amplitude from the usual model greatly decreases 
as the size of k increases, this behavior is being reflected on the covering 
percentage decreasing to less than 95%. Adopting the correct model we have 
that when k increases the confidence interval amplitude decreases and the 
covering percentage increases approaching 95%. 
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Table 1: Empirical bias and mean squared error, the mean estimated variance 
and theoretical variance of X . 



x 


n 


k 


Usual-M 


Proposed-M 


Usual-M 


Proposcd-M 


Theorical variance 








Bias 


MSE 


Bias 


MSE 


V(X ) 


V(X ) 


V(X ) 


0.01 


5 


2 


-0.0156 


U.UOJU 


-0.0318 


0.0334 


U 


Uoyo 


U 


m a q 

U14o 


0.0257 






20 


-0 0236 

VJ . VJ^tJU 


0.0319 


-0.0445 


0.0278 


n 
U 


Ulol 


n 

U 


U100 


0.0211 






100 


-0.0183 


0306 


-0.0429 


0.0276 


n 

U 


UUo4 


U 


U10O 


0.0207 




20 


2 


-0.0076 


0.0119 


-0.0049 


0.0100 


n 
U 


UoDO 


n 
U 


nn^ 

UUOO 


0.0097 






20 


-0 0055 


0.0074 


-0.0073 


0055 

yj . yjyjijiJ 


n 
U 


nnsi 
UUol 


n 
U 


UUoO 


0.0051 






100 




u.uuuo 


-0.0101 


OO^iO 


n 
U 


UUoO 


U 


nn*} q 
UUoo 


0.0047 




100 


2 


yj . wuvjo 


0063 


0020 

VJ. VJVJiiVJ 


005Q 
yj • vjUtJ 


U 


UolD 


n 
u 


UU4 / 


0.0059 






20 


-0 0023 


0.0019 


-0 0020 

vj. yjyj^yj 


0.0014 


n 
U 


UU4D 


n 
u 


UUl 1 


0.0014 






100 


-0.0014 


0.0015 


-0.0013 


0.0010 


n 
U 


nm i 

UUl ( 


n 

U 


UUU / 


0.0010 




5000 


2 


0008 

VJ. UUUu 


0055 


0008 

VJ. VJVJUO 


0055 

yj • yjyjtjyj 


n 
U 


UoUU 


n 
u 


nn^n 
uuou 


0.0050 






20 


0000 


0005 

VJ. l/UUv 


0000 

vj. yjyjyjyj 


0005 

yj • yjyjyjyj 


o 


0030 


o 


0005 


0.0005 






100 


-0.0003 


0.0001 


-0.0004 


0.0001 


n 
u 


OOOfi 


n 
u 


nnm 

UUUl 


0.0001 






500 


0000 


0000 


0000 


0000 

yj . \jyj\jyj 


n 
u 


0009 

uuuz 


n 
u 


nnnn 
uuuu 


0.0000 


0.8 


5 


2 


0.0061 


0.0193 


0025 

vj. yjyj^itj 


0202 

yj . VJ £i\J£i 


U 


U.ZD4 


U 


uuoy 


0.0167 






20 


0033 


0.0135 


-0.0019 


0.0139 


n 
U 


UU4 ( 


n 
U 


nnci 
UUol 


0.0122 






100 


0.0014 


0.0132 


-0.0037 


0137 


n 
U 


UUzy 


U 


nnvc 
UU io 


0.0118 




20 


2 


0.0015 


0.0077 


0.0015 


0.0077 


U 


nom 


n 
u 


nn/i o 
UU4z 


0.0074 






20 


0.0016 


0032 


0009 

VJ. UWUC/ 


0032 


n 
U 


UUOO 


n 
u 


nnon 
uuzu 


0.0029 






100 


-0 0005 

VJ . UUUJ 


0026 

VJ. VJVJ^iU 


-0.0018 


0026 

yj . vjuzjU 


n 
U 


UU1Z 


U 


nm r 
UU10 


0.0025 




100 


2 


0.0010 


0055 

VJ. UVJiJ tj 


0.0014 


0.0054 


n 
U 


09QQ 

uzyy 


n 
u 


UU44 


0.0055 






20 


0006 

yj . uuuu 


0.0010 


0.0007 


0.0010 


n 
U 


nn'i 1 
UUol 


U 


nnno 
UUUo 


0.0010 






100 


-0.0001 


0006 

VJ. VJVJUU 


-0.0001 


0006 

yj . yjyjyjyj 


n 
U 


UUU i 


n 
u 


nnnA 

UUU4 


0.0006 




5000 


2 


0.0014 


0.0051 


0.0014 


0.0051 


U 


UoUU 


n 
u 


nn^n 
uuou 


0.0050 






20 


0006 


0005 

VJ. UVJUtJ 


0006 

VJ. UVJUVJ 


0005 

yj • yjyjyjyj 


o 


0030 


o 


0005 


0.0005 






100 


0.0001 


0.0001 


0.0001 


0.0001 





0006 





0001 


0.0001 






500 


0.0000 


0.0000 


0.0000 


0.0000 





0001 





0000 


0.0000 


1.9 


5 


2 


0.0500 


0.0802 


0.0582 


0.0704 





0432 





0275 


0.0482 






20 


0.0314 


0.0620 


0.0503 


0.0562 





0124 





0278 


0.0435 






100 


0.0434 


0.0645 


0.0594 


0.0587 





0085 





0283 


0.0430 




20 


2 


0.0070 


0.0213 


0.0054 


0.0185 





0351 





0086 


0.0166 






20 


0.0117 


0.0160 


0.0127 


0.0132 





0075 





0067 


0.0118 






100 


0.0099 


0.0161 


0.0104 


0.0130 





0033 





0064 


0.0114 




100 


2 


0.0016 


0.0080 


0.0007 


0.0076 





0312 





0055 


0.0074 






20 


0.0019 


0.0035 


0.0014 


0.0029 





0043 





0017 


0.0028 






100 


0.0001 


0.0031 


0.0009 


0.0025 





0015 





0013 


0.0024 




5000 


2 


-0.0008 


0.0051 


-0.0009 


0.0051 





0300 





0050 


0.0050 






20 


-0.0003 


0.0006 


-0.0004 


0.0006 





0030 





0005 


0.0005 






100 


-0.0003 


0.0002 


-0.0002 


0.0001 





0006 





0001 


0.0001 






500 


0.0000 


0.0001 


0.0000 


0.0001 





0001 





0000 


0.0001 



4 Application 

In this section we illustrate the usefulness of the proposed model by apply- 
ing it to the data supplied by the chemical laboratory of the "Instituto de 
Pesquisas Tecnologicas do Estado de Sao Paulo (IPT)" - Brasil. The out- 
come from the proposed approach are also compared with the results from 
the usual model. Our main interest is to estimate the unknown concentration 
value X of a sample of the chemical elements such as chromium, cadmium 
and lead. 

Table [3] below presents the fixed values of concentration for the standard 
solutions with their related uncertainty (u(Xi)) and the corresponding in- 
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Table 2: Covering percentage (%) and amplitude (A) of the intervals with a 
95% confidence level for the parameter X . 



X 


n 


k 


Usual-M 


Proposed-M 








% 


A 


% 


A 


0.01 


5 


2 


89 


0.35 


78 


0.22 






20 


78 


0.21 


89 


0.24 






100 


70 


0.17 


88 


0.24 




20 


2 


100 


0.37 


74 


0.13 






20 


95 


0.17 


90 


0.12 






100 


85 


0.12 


90 


0.11 




100 


2 


100 


0.35 


84 


0.13 






20 


100 


0.13 


91 


0.06 






100 


96 


0.08 


90 


0.05 




5000 


2 


100 


0.34 


94 


0.14 






20 


100 


0.11 


95 


0.04 






100 


100 


0.05 


94 


0.02 






500 


100 


0.02 


94 


0.01 


0.8 


5 


2 


90 


0.28 


78 


0.18 






20 


73 


0.13 


87 


0.17 






100 


63 


0.10 


87 


0.17 




20 


2 


100 


0.33 


73 


0.11 






20 


95 


0.12 


87 


0.09 






100 


81 


0.07 


88 


0.08 




100 


2 


100 


0.34 


86 


0.12 






20 


100 


0.11 


91 


0.05 






100 


97 


0.05 


89 


0.04 




5000 


2 


100 


0.34 


95 


0.14 






20 


100 


0.11 


95 


0.04 






100 


100 


0.05 


95 


0.02 






500 


100 


0.02 


93 


0.01 


1.9 


5 


2 


78 


0.35 


81 


0.31 






20 


59 


0.20 


86 


0.32 






100 


51 


0.17 


87 


0.32 




20 


2 


98 


0.36 


78 


0.17 






20 


81 


0.17 


84 


0.16 






100 


62 


0.11 


84 


0.16 




100 


2 


100 


0.34 


87 


0.14 






20 


97 


0.13 


87 


0.08 






100 


83 


0.08 


84 


0.07 




5000 


2 


100 


0.34 


95 


0.14 






20 


100 


0.11 


94 


0.04 






100 


100 


0.05 


93 


0.02 






500 


99 


0.02 


89 


0.01 



tensities for the chromium, cadmium and lead elements. The uncertainties 
considered are computed using the method recommended by the ISOGUM 
guide (see [11]) and the intensities are supplied by the plasma spectrome- 
try method. This data is referred to the first stage of the heteroscedastic 
controlled calibration model. 

Moreover, Table H] below presents the intensities of the sample solutions 
of chromium, cadmium and lead elements. These data are referred to as the 
second stage of the calibration model. 

Observing Tables [3] and H] we verify that the uncertainty values increase 
with the concentration values. 

We consider crf t = u(Xi) 2 . The expanded uncertainty U(X ) is obtained 
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Table 3: Concentration (mg/g), uncertainty and intensity of the stan- 

dard solutions of chromium, cadmium and lead elements. 



Chromium element 


Cadmium element 


lead element 


x t 


u(Xi) 


Intensity 


x % 


u(Xi) 


Intensity 


x t 


u(Xi) 


Intensity 


0.05 


0.00016 


6455.900 


0.05 


0.00016 


4.89733 


0.05 


0.00015 


0.9471 


0.11 


0.00027 


13042.933 


0.10 


0.00027 


9.706 


0.10 


0.00025 


1.46833 


0.26 


0.00040 


32621.733 


0.25 


0.00041 


23.41333 


0.26 


0.00039 


3.09033 


0.79 


0.00122 


97364.500 


0.73 


0.00122 


69.73 


0.77 


0.00117 


8.40533 


1.05 


0.00161 


129178.100 


1.01 


0.00168 


96.85667 


1.01 


0.00155 


10.92667 



Table 4: Intensity of the sample solutions of chromium, cadmium and lead 
elements. 



Chromium element 


Cadmium element 


Lead element 


10173.6 


5.066 


1.303 


10516.9 


5.027 


1.290 


10352.2 


5.085 


1.341 



multiplying the squared root of the estimate of variance of Xq by the value 
1.96 (see [2] and (£]). 

We use the optim command from R-project program to estimate the pa- 
rameters (3 and erf on the likelihood function of the proposed model f)2.6p . We 
use as initial point the estimates from f3 = J2i=i i-^-i — ^) (Yi ^h=i P^i ~~ 

X) 2 and erf = J2i=i0^oi — ^o) 2 / n , which are the estimators from the ho- 
moscedastic controlled calibration model when erf is unknow [6]. 

Table [5] presents estimates of a, /3, X , V(X ) and the expanded uncer- 
tainty, U(X Q ), from the proposed model (Proposed-M) of chromium, cad- 
mium and lead elements. Also, we present the estimates obtained from usual 
calibration model (Usual-M) to observe the performance of both models. 

In Table [5], for cadmium and lead elements, we observe that the estimates 
of a, (3 and Xq from the Proposed-M and Usual-M are the same. For the 
chromium element, there are small differences. Also, we observe that for 
the chromium element there is a small difference between the estimates of 
X and U(X ) respectively obtained from the usual model and the proposed 
model. Despite the relevant estimates of a,/3 and Xq from both approaches 
for cadmium and lead element match, the estimates of V^Xn.) and U(Xq) dif- 
fer considerably, the estimates obtained adopting the usual model is greater 
than the estimates outcome supplied by the proposed model. 



5 Concluding remarks 

The expanded uncertainty of X from the proposed model arises from the 
errors appearing in the both process, the reading of equipment and the het- 
eroscedastic error in the preparation of standard solutions. We observe that, 



9 



Table 5: Estimates of a, j3, X , V(Xq) and U(X ) related to usual and het- 
eroscedastic model, for the chromium, cadmium and lead element. 



Parameters 


Chromium element 


Cadmium element 


Lead element 


Usual-M 


Proposed-M 


Usual-M 


Proposed-M 


Usual-M 


Proposed-M 


a 


134.9469 


124.2801 


0.454801 


0.454801 


-0.3822126 


-0.3822126 


P 


123003.7 


123027.3 


10.54381 


10.54381 


94.29881 


94.29881 


X 


0.08302691 


0.08309769 


0.08123556 


0.08123556 


0.05770535 


0.05770535 


V(X ) 


4.357870e-06 


4.474395e-06 


7.898643e-05 


4.440342e-06 


0.0001181068 


7.237226e-08 


U(X Q ) 


0.004091601 


0.004145942 


0.01741936 


0.004130135 


0.02130068 


0.000527281 



despite the classical model only considers the error originated from equip- 
ment reading, there are some applications in which the expanded uncertainty 
is greater than the one obtained through the new approach. 

Various aspects of the model studied above deserve attention in future 
research, e.g. it is not considerated the error arisen from the test sample so- 
lution preparation, the proposed model can be studied by considering other 
type of distribution of the errors, such as skew normal distribution [12]. In 
particular, one of the drawbacks of the usual model is that it does not con- 
sider the error in the independent variable, we believe that despite that this 
error being very small, it must be considered as an important property of 
the calibration model. We will concentrate on one of the problems described 
above in a future work. 
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A Usual calibration model 

The first and second stage equations of the usual linear calibration model are 
given, respectively, by 

Yi = a + f3xi + 6i, i = \,2---,n, (A.l) 
Y 0i = a + (3X + €i, % = n + l,n + 2, • • • ,n + k. (A. 2) 

It is considered the following assumptions: 

• X\,X2, - ■ ■ ,x n take fixed values, which are considered as true values. 

• ei, 62, • • • , e n+ k are independent and normally distributed with mean 
and variance a 2 . 

The model parameters are a, (3, X and of and the main interest is to estimate 
the quantity Xo. 

The maximum likelihood estimators of the usual calibration model are 
given by 

& = Y-$x, $ = ^, X = ^^, (A.3) 

^xx p 
-| n n+k 

°l = — r[E(*-«-fe) 2 + E(^-io) 2 ], (A.4) 

71 "+" K i=l i=n+l 

where 

j n \ n \ 11 



X 



-E^> F = -E^> ^ = -E(^-*)(^-n 
n ^ n ^ 



^ n n+fc 
'xa: = — E( a '* _ ^) ' ^0 — — E ^0*- 



The approximation of order n 1 for the variance of X is given by 

(A.5) 



r,(.Y„) - a < 



/? 2 



1 1 (X-Xr^ 2 



In order to construct a confidence interval for X , we consider that 

X) — X) D 



X(0,1), (A.6) 



hence, the approximated confidence interval for Xo with a confidence level 
(1 — a), is given by 



X - z~ v / ^(Xo),X + V^(X )J , (A.7) 
where z<* is the quantile of order (1 — f ) of the standard normal distribution. 
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